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1 .This document has been translated by computer. So the translation may not reflect the original 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 

The approach and equipment which project a sound source to a loudspeaker Especially this 
invention relates to the approach and equipment which project a sound source to a loudspeaker, 
in order to enable space playback of a sound source. 

the conventional technique It is known to aim at the space expression which is also called the 
multi-channel stereo for audio playback and surround voice from MPEG-2 specification ISO 
13818 and which is boiled and depended. Six channels are prepared in multi-channel voice in 
this case, and among those, three channels (the left, a center, right) are arranged in the space 
ahead of a listener, two channels (left surround, right surround) are arranged in the space behind 
a listener, and the 6th channel is prepared in order to reproduce the tone of a low pitch for special 
effect. The voice channel is matrixed, in order to ensure reverse compatibility with MPEG-1 
audio signal, and in order [ when only one pair of loudspeakers instead of a perfect surround 
voice loudspeaker gestalt exist, ] to enable sufficient playback. In this case, the calculated stereo 
signal is transmitted as an MPEG-1 compatibility stereo signal, and the signal which remains is 
transmitted as additional data. «H 
Invention This invention aims at specifying the approach for space playback of a virtual source. ^ 
This purpose is attained by the approach specified as claim 1 . ^ 
This invention aims at specifying the equipment for applying the approach by this invention. ^ 
This purpose is attained by the equipment indicated by claim 8. J> 
In order to reproduce an audio signal, the latter frequency must be projected in the location of the 00 
existing loudspeaker. Some following projection is mentioned as an example. [jj 

(a) Project a mono-signal to one pair of stereo loudspeakers. ~ 

(b) Project 3/2 signal (two loudspeakers a loudspeaker/behind front) to 2 / 2 loudspeaker ^ 
arrangement. [ three ] U 

(c) It is separated 3 m and project the signal of 30 degrees of left, and the location of 10 degrees % 
of upper parts on the loudspeaker ring arranged at intervals of 45 degrees in the distance whose 

eight loudspeakers are 2m, respectively. 

(d) Project two indoor sound sources to two loudspeakers. 

For transmission of an audio signal, it is not desirable that it must be fixed on a specific gestalt. 
However, there is a problem that there is possible combination infinite. 

The above-mentioned sound source is theoretically interpreted for the approach by this invention 
for projecting a sound source to up to a loudspeaker as a sound object, and a sound object 
consists of the item of the space information which specifies the spatial position of imagination 



v of an audio signal and the above-mentioned sound source as a sound source being assigned and 
constituted. 

Advantageously, an audio signal is processed as a function of an item with which space 
information is related, in order to reproduce a sound object. 

In this case, desirably, the spatial position of a loudspeaker is further taken into consideration, 
the virtual distance between a sound source and a loudspeaker is calculated from space 
information and the location of a loudspeaker, and separate processing of an audio signal is 
performed to each loudspeaker a sake [ for sound ]. 

Furthermore, the following parameters, i.e., damping, or amplitude attenuation called diffraction 
when processing the above-mentioned audio signal A different travelling period over various 
loudspeakers for sound It is advantageous that one or more of consideration of dependence of the 
loudspeaker level on the spacial configuration by the external ear function are taken into 
consideration. 

In this case, processing of an audio signal will improve further, if frequency dependent [ of the 
above-mentioned parameter ] is taken into consideration. 

The mathematical function needed in order to take the above-mentioned parameter into 
consideration, for example, an attenuation function, is transmitted and/or memorized as a 
function of distance and/or a deflection angle. 

It is advantageous, especially if the data for sound follow MPEG-4 specification and are 
memorized and/or transmitted by the compression data stream. 
Theoretically, the equipment by this invention for projecting a sound source to up to a 
loudspeaker consists of the arithmetic unit which calculates the distance between each 
loudspeaker for virtual sound being prepared from the actual location of the item of the space 
information transmitted with the audio signal, and a loudspeaker. 

In this case, it is desirable to prepare the memory the mathematical function for taking into 
consideration the location and/or parameter of a loudspeaker of each above should be 
remembered to be. 

The actuator (7, 8, 9) of nxk is formed to the loudspeaker for [ of n ] sound of k, and, as for an 
actuator, it is advantageous to perform processing for sound with reference to any one of the 
above-mentioned loudspeakers. 

In this case, frequency dependent [ of the above-mentioned parameter ] is taken into 
consideration also by the above-mentioned actuator, a signal is first divided by the split filter 
(10) to a frequency band, each frequency band is processed separately next, and the frequency 
band by which processing was carried out [ above-mentioned ] continuously is recombined with 
a merge filter (12). 

It is especially advantageous when the above-mentioned split filter and/or the above-mentioned 
merge filter are a part of audio decoders in which it exists in any cases. 
Furthermore, it is desirable to form one or more directional microphones used in order to 
measure the location of the above-mentioned loudspeaker. 

As for the above-mentioned directional microphone, being unified in remote control is desirable. 
Drawing The typical example of this invention is hereafter explained with reference to a 
drawing, and it is the inside of drawing, Drawing 1 is drawing showing the virtual source on 
which it should be projected to the existing loudspeaker pair. Drawing 2 is drawing showing the 
diagrammatic expression of the model which calculates a voice way. Drawing 3 is drawing 
showing the block diagram of the expression circuit of the model explained. Drawing 4 is 
drawing showing a part of audio decoder by this invention. 



c? Typical example A typical problem is shown in drawing 1 . Two virtual sources 3, i.e., a violin, 
and a trumpet should be projected by one pair of existing loudspeakers 2 so that an impression 
by which a listener 1 is stationed in the spatial position where a violin and a trumpet are shown 
in drawing 1 may be received. 

The model for this projection can be formed based on the following observation. There is a 
person in the room which has the aperture by which plurality was opened wide. ** called various 
sound sources of the alarm whistle of a street musician and an automobile etc. and a following 
sound object exists in the outside of the room. Even if various sound sources are not in sight as 
for a person, he understands the location of a sound source acoustically substantially. This is 
because the voice ways which pass along various apertures differ. The model explained below is 
based on replacing each aperture by the loudspeaker. Supposing the loudspeaker is operating 
correctly, it is **** in which what the same sound field are generated, therefore the location for 
sound understands similarly is possible. 

Drawing 2 is drawing showing the diagrammatic expression of a model. This room has the wall 
5 which consists of an absorber ingredient by getting down into the room of the configuration of 
arbitration, therefore voice does not pass from the exterior, and reflection does not produce a 
listener 1 inside the room. A sound source 3 is arranged fundamentally on the outside of the 
room. A loudspeaker or an aperture is taken into consideration with the hole 6 of the wall of the 
room. This generates various voice ways 4 which led various loudspeakers or the aperture 
opening 6 to the listener 1 from the sound source 3. Voice advances into the room through all 
loudspeakers or aperture openings, although each voice way has the description of itself in this 
case. 

Drawing 3 is drawing showing the block diagram of an expression circuit from which a model 
should be changed in it. The violin for [ two / 3 ] sound and a trumpet are projected in this case 
on three existing loudspeakers. In order to enable the drive according to each virtual voice way, 
an audio signal is processed to each sound object as a function of the virtual space location for [ 
this ] sound, and the actual location of each loudspeaker. If it becomes common as a loudspeaker 
of k for [ of n ] sound, it means that the actuator of nxk is used. In this case, according to a 
virtual voice way, the following one or more parameters 7, 8, and 9 in each actuator are taken 
into consideration. Since the amplitude is driven correctly, the latter must be first calculated as a 
function of the die length of a way. Furthermore, the consideration to attenuation or absorption 
with air must be made. In this case, a different function depending on attenuation of the class of 
sound source or air must be taken into consideration. Therefore, for the power which loses the 
sound power by square [ of distance ], namely, is received, spherical sound sources are the 
following formulas. Power received (r) : = it is given by the power transmitted / r2. 
On the other hand, cylindrical sound sources, such as a train or a road, lose the sound power with 
a simple distance, for example. Although it memorizes in an expression circuit in this case and 
being got, it is transmitted similarly, each function is memorized with a signal, and it deals in it. 
These are similarly determined by each application or user, and it deals in them. Furthermore, it 
is also possible to take into consideration the diffraction produced in a loudspeaker or aperture 
opening. In order to make it possible to take these diffraction effects into consideration correctly, 
diffraction must be calculated by the geometric configuration of a specific hole by total of all 
voice ways in consideration of a frequency and a phase. Thereby, in approximation, on a low 
frequency, independently of an angle of incidence, propagation arises in all the directions, and, 
on the other hand, it is the function of the include angle between the directions out of which the 
amplitude of an audio signal comes on a high frequency with the direction of each hole into 



o which it goes. An approximate expression is used in order to decrease, and it deals in the costs on 
count. It is transmitted to coincidence and deals in this formula, or as mentioned above about the 
case of attenuation, it is set up by application or the user and deals in it again. The diffraction 
effect needs to take the dependence to this frequency into consideration, in order for it to be 
possible to calculate diffraction attenuation correctly in order to be dependent on a frequency. In 
order to realize this technically, it is required to divide a signal to a frequency band, using the 
filter which has a group's decided time delay, and to process them separately. 
As shown in drawing 4 , the split filter 10 can divide in this case, following it, processing is 
performed by various actuators 1 1 and the signal processed at the end is recombined with the 
merge filter 12. Since it performs in a frequency domain, for this reason the split filter is already 
prepared, in the case of MPEG, AC3, or an ATRAC signal, it may be unified to MPEG, AC3, or 
the typical audio decoder for ATRAC signals, and especially these processings do not need to 
prepare a split filter additional as a result. 

The further parameter is the travelling period (delay) of a signal. Here, it is applicable that the 
acoustic wave which is equivalent to a lug first participates in the cognition of a direction 
deterministically theoretically. When the die length of a way is r and the mean velocity c of a 
sound is about 340 m/s It is materialized that it is (Delay r):=r/c, 

In this case, the minimum distance between a loudspeaker and a listener is shortened and it deals 
in die-length r. This decreases the requirements for storage in an expression unit. 
Between a sound source and human being's eardrum, ** called the transfer function depending 
on a direction and a frequency or an external ear function exists. If it states briefly, unlike the 
sound from back, the filter of the sound from the front will be carried out by the muscles of a lug. 
If it is a request to emanate by the loudspeaker in which the virtual source positioned by the 
include angle x is prepared at an include angle z, the external ear function should be taken into 
consideration, this — the difference between a virtual location and a loudspeaker location a 
level signal is determined and it is required that a signal should be filtered suitably. 
An external ear function can consider that a user is able to choose from various external ear 
functions for especially good amendment since it is not the same to all men. 
Here, the actuator in the frequency side of an audio decoder realizes, and it deals in a filter again. 
The location of an actual loudspeaker must be determined that it will decide the die length of the 
way between the actual loudspeakers for virtual sound. For this reason, various approaches can 
be considered. Therefore, a user can measure the space coordinates of the location of each 
loudspeaker case using a meter ruler etc., and can input corresponding distance data into the 
input unit relayed to an expression circuit. An input is performed here using the keyboard or 
remote control of suitable equipment, and is obtained, and if suitable, a user is able to be guided [ 
to supervise input data or ] by the display on the screen of a display unit or view equipment. 
Moreover, it is possible to measure a loudspeaker system with one or more directional 
microphones so that a user may not measure distance mechanically. The distance from a 
directional microphone to a loudspeaker reproduces the test sequence which has a pulse through 
a loudspeaker in this case, and is determined by measuring a travelling period, and it deals in it. 
Next, the include angle of each loudspeaker is determined by the directive description of a 
directional microphone, and it deals in it. Then, it is possible to measure a loudspeaker gestalt 
automatically. It is obvious to unify a microphone in remote control in this case especially. 
The whole die length of the way of imagination is generated next from the location for virtual 
sound, and the location determined about each loudspeaker as mentioned above. In this case, the 
possibility of various expressions can be considered to two locations, therefore, assignment and 



- the horizontal angle of assignment of distance [ in / in this / the three directions of all in the 
Cartesian coordinate, i.e., space, ], or a polar coordinate, i.e., distance, ~ if suitable, it will 
perform by assignment of a perpendicular angle and will get. 

Surely the change in the virtual location for sound while the location of a loudspeaker must be 
kept eternal in almost all cases is often produced. Especially this is an audio signal. 
It is applied when reproduced in connection with a ** video signal. It follows, for example, in 
the case of a long movie, an actor or a car can move in a screen top, it can disappear from a 
screen, therefore a spatial location is changed, and it gets. Similarly, a game participant is moved 
by the player using a joy stick, and it is possible that playback of the sound signal assigned to the 
game participant suits according to the location ordered or changed by the player with the 
computer game which has a voice output. 

This invention is used in order to follow MPEG-4, MPEG-2, or AC3 specification and to record 
and reproduce it not only to to transmit a digital audio signal, but, and it deals in it. This is 
playback of the audio signal according to the video signal in for example, the pure audio signal 
playback by the CD player, DAB, or the ADR receiver and a DVD player, or a digital television 
receiving set, and it deals in it. Furthermore, also in the case of a TV phone or a mutual 
interactive system called a computer game, it thinks in this case. 



[Translation done.] 
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CLAIMS 



[Claim(s)] 

1 . It is the approach of projecting a sound source (3) to up to a loudspeaker (2). The above- 
mentioned sound source (3) is an approach which is interpreted as a sound object and 
characterized by assigning the item of the space information which specifies the spatial position 
of imagination of an audio signal and the above-mentioned sound source as a sound source, and 
constituting this sound object. 

2. The above-mentioned audio signal is an approach according to claim 1 characterized by being 
processed as a function of an item with which space information is related in order to reproduce 
a sound object. 

3. It is the approach according to claim 2 which the spatial position of the above-mentioned 
loudspeaker (2) is further taken into consideration, and the virtual distance between a sound 
source and a loudspeaker is calculated from space information and the location of a loudspeaker, 
and is characterized by performing separate processing of an audio signal to each loudspeaker a 
sake [ for sound ]. 

4. the time of processing the above-mentioned audio signal - the following parameters — 
namely, ~ For example, damping or amplitude attenuation (7) called diffraction A different 
travelling period (8) over various loudspeakers for sound Approach according to claim 2 or 3 
characterized by taking into consideration one or more of consideration (9) of dependence of the 
loudspeaker level on the spacial configuration by the external ear function. 

5. Frequency dependent [ of the above-mentioned parameter ] is an approach according to claim 
4 characterized by what is taken into consideration also in processing of an audio signal. 

6. The mathematical function needed in order to take the above-mentioned parameter into 
consideration, for example, an attenuation function, is the approach according to claim 5 
characterized by what is transmitted and/or memorized as a function of distance and/or a 
deflection angle. 

7. The data for sound are [ claim 1 characterized by following MPEG-4 specification, and being 
memorized and/or transmitted by the compression data stream thru/or ] an approach given in any 
1 term among 6. 

8. It is equipment which projects a sound source to up to a loudspeaker. It is equipment which 
the above-mentioned sound source is interpreted as a sound object, and the actuator (7, 8, 9) of 
nxk is formed to the loudspeaker for [ of n ] sound of k, and is characterized by an actuator 
performing processing for sound with reference to any one of the above-mentioned loudspeakers. 

9. an actuator - the following units ~ namely, — Unit for amplitude adjustment (7) Time delay 
unit (8) for amending a different travelling period Equipment according to claim 8 characterized 



<& by including at least one of the units (9) for taking an external ear function into consideration. 

10. It is equipment according to claim 9 which frequency dependent [ of the above-mentioned 
parameter ] is taken into consideration also by the above-mentioned actuator, a signal is first 
divided by the split filter (10) to a frequency band, and each frequency band is processed 
separately next, and is characterized by recombining the frequency band by which processing 
was carried out [ above-mentioned ] continuously with a merge filter (12). 

1 1 . The above-mentioned split filter and/or the above-mentioned merge filter are equipment 
according to claim 10 characterized by being a part of audio decoder in which it exists in any 
cases. 

12. It is [ claim 8 characterized by preparing the arithmetic unit which calculates the distance 
between each loudspeaker for virtual sound from the actual location of the item of the space 
information transmitted with the above-mentioned audio signal, and a loudspeaker thru/or ] 
equipment given in any 1 term among 1 1 . 

13. It is [ claim 8 characterized by preparing the memory the mathematical function for taking 
into consideration the location and/or parameter of a loudspeaker of each above should be 
remembered to be thru/or ] an approach given in any 1 term among 12. 

14. It is [ claim 8 characterized by forming one or more directional microphones used in order to 
measure the location of the above-mentioned loudspeaker thru/or ] equipment given in any 1 
term among 13. 

15. The above-mentioned directional microphone is equipment according to claim 14 
characterized by being unified in remote control. 



[Translation done.] 
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